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Inter-Robot Interactions in 
Multi-Robot Systems Using Braids 

Yancy Diaz-Mercado and Magnus Egerstedt 


Abstract —This paper describes a framework for multi-robot 
coordination and motion planning with emphasis on inter-agent 
interactions. We focus on the characterization of inter-agent 
interactions with sufficient level of abstraction so as to allow 
for the enforcement of desired interaction patterns in a provably 
safe (l.e., collision-free) manner, e.g., for achieving rich movement 
patterns in a shared space, or to exchange sensor information. We 
propose to specify interaction patterns through elements of the 
so-called braid group. This allows us to not focus on a particular 
pattern per se, but rather on the problem of being able to execute 
a whole class of patterns. The result from such a construction is 
a hybrid system driven by symbolic Inputs that must be mapped 
onto actual paths that both realize the desired interaction levels 
and remain safe in the sense that collisions are avoided. 


I. Introduction 


M any applications have been proposed for multi¬ 
robot systems. For example, the multi-robot foraging 
paradigm, in which agents wander around an environment 
searching for items of interest Q. 0. can relate to many 
real-world problems (e.g., waste or specimen collection in 
hazardous environments, explosive detection and disposal, and 
search and rescue operations after a crisis such as floods and 
earthquakes). Another application of interest in the research 
community and in industry is cooperative assembly 0, g and 
self-assembly 0^ ©■ In the cooperative assembly scenario, 
multiple robots need to coordinate their motion in order to 
cooperatively assemble a structure using a possibly heteroge¬ 
neous set of tools, end effectors, skills, or parts. Similarly, in 
the self-assembly scenario, multiple robots need to coordinate 
their motion in order to collectively form a structure or achieve 
a geometric configuration. There has been a recent push for 
robotic farming and precision agriculture 0,0, where a fleet 
of robots is sent to gather data on the status of crops, tend 
to and harvest them. In some communication architectures, 
mobile agents called data MULEs or message ferries 0- 
|TT) are used to transport data between sensors, access points, 
or base stations, in situations where it is impractical to 
establish physical communication. Multi-robot simultaneous 
localization and mapping (SLAM) takes advantage of the robot 
team’s size to attain a more complete (or more detailed) map 
faster than with a single robot by combining information from 
multiple sources and coordinating motion fT^ , |13|. Other 
applications include transportation systems (e.g., intelligent 
highways, air traffic control) E)’ and the convoy protection 
scenario (e.g., surveillance, coverage) m- 
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In many of these applications, the overall objectives can 
be stated in terms of making a team of robots follow a 
physical path, such as a road or the movements of a ground 
convoy, while ensuring that particular search patterns are 
executed 116|- m- These patterns should be selected in such 
a way that certain secondary geometric objectives are met, 
including ensuring that an area along the path is covered, that 
multiple views of the same objects are achieved, that an aerial 
vehicle is always on top of the convoy, or that sufficiently 
many vehicle-to-vehicle interactions take place for the purpose 
of information sharing p9) , | [20) . In this work, we collect 
all of these different secondary objectives under one unified 
banner, namely multi-robot mixing. In particular, we specify 
interaction patterns with certain desired levels of mixing, and 
then proceed to generate the actual cooperative movements 
that realize these mixing levels. 

In this paper we study the problem of characterizing inter¬ 
robot interactions for the sake of coordination and collision 
avoidance. We specify the mixing patterns through elements 
of the so-called braid group pT) , p2] , where each element 
corresponds to a particular mixing pattern, i.e., we do not focus 
on a particular pattern per se, but rather on the problem of 
being able to execute a whole class of patterns. The result 
from such a construction is a hybrid system driven by symbolic 
inputs p3| , i.e., the braids, that must be mapped onto actual 
paths that both obtain the mixing level specified through the 
braid, and remain safe in the sense that collisions are avoided. 

The use of symbolic inputs allows us to abstract away 
the geometry and physical constraints involved in the multi¬ 
robot motion planning. As described in | [23| , this provides 
the advantage of hierarchical abstractions that are typically 
broken into three stages. At the top layer is the specification 
level, which describes the motion tasks (such as robots A and 
B should interact, and arrive at the goal simultaneously). The 
second layer is the execution level, which describes how to 
obtain the motion plans, e.g., by generating trajectories based 
on optimality conditions. The bottom layer is the implemen¬ 
tation level, which concerns itself with constructing the robot 
controller, e.g., to track a reference trajectory. This work also 
extends the notions presented in | [24) for trajectory tracking of 
virtual vehicles. The idea there is to have the physical vehicles 
track a virtual vehicle, as opposed to a path (or trajectory) 
itself The virtual vehicle, which is being controlled directly 
with simplified dynamics, can be controlled in order to track a 
reference path while satisfying the constraints, compensating 
for the physical vehicle’s dynamics and other disturbances. 

The outline of the paper is as follows: in Section [I^ we 
start with a brief summary of the existing literature on braid- 
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ing for the sake of multi-robot motion planning; in Section 


11-B the braid group is introduced as a way of specifying 


mixing levels and the corresponding symbolic braid objects 
are given a geometric interpretation in terms of planar robot 
paths; controllers are then proposed so that mixing strategies 
satisfying a given specification can be executed by a class of 
robots as described in Section]^ together with a bound on the 
highest achievable mixing level. In Section|IVj implementation 
of these controllers on actual robotic platforms is addressed, 
and these ideas are deployed on a team of actual mobile robots. 
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(a) Two robots, orig¬ 
inally at one side of 
a square, map to the 
other. 


(b) Three braids for two planar agents. Note that 
“strand” 1 goes over “strand” 2 in cri and vice versa 
in (71. 


Fig. 1. Two-robot interactions and corresponding symbolic braids. 


II. Braids and Robotics 


The use of braids for robot motion planning has been 
considered before. Using the notion of configuration space 
| [25] for robot motion planning, p6| studies the problem 
of construction and classification of configuration spaces for 
graphs, e.g., robots on a manufacturing floor constrained on 
rails or paths. By studying the topological data associated with 
these graphs, such as the braid groups, he is able to provide 
a measure of the complexity of the control problem (e.g., the 
construction of potential field controllers on homeomorphic 
spaces). 

In | |27t , the graph braid group is used as the fundamental 
group of the configuration space of graphs that describe robot 
motion. There, each graph in the configuration space repre¬ 
sents discretized collision-free robotic motion plan (e.g. road 
maps), where at each discrete time the graph vertices represent 
the positions of robots and (possibly moving) obstacles, and 
the edges represent fixed tracks connecting these vertices. 
They present an algorithm to construct the presentation of the 
graph braid group of N agents, where the group generators 
(i.e., the braids) represent actual paths between configurations 
of robots on the graph, i.e., the motion plan to transition from 
one configuration to another. However, they only consider 
zero-size robots where they rely on a “one edge separation” 
between points at all times to avoid collisions, and as such, 
their approach is purely academic and mainly focuses on the 
combinatorics of ideal robots moving on a graph. 

We will use the braid group’s generators as symbolic 
inputs to multi-robot hybrid controllers which characterize 
and enforce collision-free interactions, take into account kine¬ 
matic and geometric constraints, and are executable on actual 
robotic platforms. This is the first approach that uses braids 
in multi-robot motion planning to symbolically characterize 
and enforce rich interaction patterns, implementable on ac¬ 
tual robotic platforms. In particular, we extend the notions 
presented in p^ , p9| . The definition on planar braids and 
their geometric interpretations are generalized from their orig¬ 


inal form presented in |28|. A controller was designed for 
nonholonomic vehicles to track a geometric path in | |29) . 
In this paper, we modify this controller to instead produce 
optimal trajectories that are provably safe in the collision-free 
sense, satisfy a set of spatio-temporal constraints, and follow 
desired geometric paths (Section III-B| i. This also allows us 
to obtain tighter bounds on the amount of interaction patterns 
that are achievable in a space than the one found in p9) . Two 
new contributions to this work are found in Section |III-C| 


where these trajectory generating controllers are extended to 
non-rectangular regions, and Section IV-A| which includes 
development of an optimal trajectory tracking controller with 
formal guarantees on optimality and spatio-temporal constraint 
satisfaction. 


A. Planar Braids 


Consider two agents on a square, initially located at the 


two left vertices of the square as in Fig. la The agents’ task 
is to move to the two right vertices of the square. There are 
two ways in which these target vertices can be assigned. The 
first is to simply let the robots move along a straight line 
while the second is to have them cross paths and move to 
vertices diagonally across from their initial placement. If the 
robots are not to collide with each other, one agent can cross 
the intersection of the two paths first, and then the other (or 
vice versa). In the braid group, these two options correspond 
to different “braids,” and we have thus identified three planar 
braids for two agents, as shown in Fig. Let us momentarily 
denote these three braids, 

Now, given these three braids, we can concatenate them 
together to form other braids, as seen in Fig.|^ The left braid is 
given by cti -cti and the right braid is cri-di. In the braid group, 
what really matters is not the geometric layout of the paths, but 
how the paths wrap around each other. As can be seen, if we 
were to “pull” the right comers in (Ti (Ti, the “strands” would 
get “tangled” in the middle, while a “stretched-out” cti • di is 
simply (To- Thus we let o-q be the identity braid, such that ui 
and di are each others’ inverses in the sense that 


CTi • I7i — (Ti • (Ti — (Tq. 

In fact, every braid has an inverse and, as such, the set of braids 
(together with the concatenation operation) is indeed a group. 
And, as = cti (and crj"^ = cti), ctq and cti (or ctq and 
(Ti for that matter) are the so-called generator braids for this 
group in that all planar braids can be written as concatenations 
of these two braids and their inverses HD, HI- 

This notion of generator braids can be extended to the case 
when there are A^ > 2, with the only difference being that 
we will have N generators rather than just two, i.e., let ag 
be the trivial generator with no interactions and tjk denote the 
interactions between agents k and A:-|-l, fc = l,...,A^ — 1. 
If we let Eat be the set of all planar generator braids over 
N agents, this set will serve as the alphabet over which braid 
strings (themselves braids) are produced from, and we let 
denote the set of all braids of length M (i.e., braids composed 
of M generators) over N agents. 
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Fig. 2. Two concatenated braids cri ■ tri and cti ■ (ji. The latter of these two 
braids is the same as the identity braid ag. 


B. A Geometric Interpretation 


Although heavily inspired by geometry in |21|, the braid 
group is not concerned with the actual geometry of the braid 
strands. For the sake of describing the robot motion plans, 
we will associate geometric paths with the different braids. 
First of all, we assume that the braid is geometrically located 
in a rectangular area of height h and length ^ no matter 
how long the braid string is. Using the particular two-agent 
braids discussed in the previous paragraphs, we assume that 
the two agents are initially located at the points (0,0) and 
(0,/i), while the final locations are at (£, 0) and If 

the total braid results from the use of one single generator 
braid ao, or ai then no additional points are needed. However, 
if the braid has length 2, then we also need to introduce 
intermediary “half-way” points {i/2, 0) and (f/2, h). As such, 
we let V 2 = , {-^i,hj\ be a set of uniformly 

spacecj^ positions for these intermediary points, where the 
subscript 2 denotes the two-agent case, M is the length of 
the braid to be executed, and g = 0,1,..., M. 


Using this notation, we can refer back to Fig. la and say that 
each of the two generator braids cotTespond to an assignment, 
i.e., a bijective map, between and V^, and we use the 
following notation to denote this fact 


(Ti : 7^2 “^6 ^ 2 1 * — 0,1 


where denotes “bijection”. Note that this is a slight abuse 
of notation in that ai now denotes both an element in the braid 
group as well as a map - this distinction, however, should be 
entirely clear from the context. Further, we will refer to these 
points which agents are bijectively mapped to and from as 
braid points. 

If we generalize this to N > 2 agents and let a denote a 
string of generators of length M >2, i.e., a G we will 
use the notation 




'Unless otherwise stated, the rest of this document we will assume these 
sets of intermediary points are uniformly spaced in h and i, but the notions 
presented here extend to points which are not, as the application demands. 
More on this in Section [in-C| 


cr(l) cr(2) 



I 

vl = {(0, 0), (0, 0.5/1), (0, h)} Pi = {{1, 0), {I, 0.5/r), {I, /r)} 
Pi = {(0.5f, 0), (0.5f, 0 . 5 / 1 ), (0.5f, h)} 

Fig. 3. The geometric interpretation of braid string a = (72 • (ti for the 
three-agent case. In this example, cr{l) = (T 2 and maps to V^, while 
cr(2) = C7i and maps to 


where a (k) is the k^^ braic0in the string a and 


-pi _ 
' N — 


{(m^’ O) I ( 


(tv-l)' 


( 


2 h 
’ (Af-l)"" 




as shown for the three-agent case in Fig. 

We moreover use the notation ^{i,j) G to denote the 
point agent j should go to at step i, i = 1,..., M. We use 
the convention that ^(0,j) = (0, (j — l)h/{N — 1)), j = 
1,2,..., N, to denote agent j’s initial position. In other words. 


= o-(l)(C(0, j)): 

C(2, j) = cr(2)(^(l,j)) = cr(2) ocr(l)(C(0,j)), 


or more generally. 


iiij) = o-(*)(C(* - l,j)) 

= a{i) o a{i - 1) o ■ ■ ■ o a{l){^{0, j)), 

where we use the (•) notation to denote the argument to 
a{i) and o to denote composition. This construction is also 
illustrated in Fig. for the three-agent case. 

The geometric interpretation we will make of the planar 
braids is that the mobile agents that are to execute them must 
traverse through these braid points. They must moreover do 
so in an orderly and safe manner, which will be the topic of 
the next section. 


III. Executing Braids 
Given a collection of N agents with dynamics 

ij = f{xj,Uj), 


and planar output 

Vj = h{xj) j = l,...,N, 


^Note that a “braid” here refers to a member of the braid group, e.g., a 
single generator (viz., a single bijective map) or a concatenation of several 
generators (viz., a composition of bijective maps). 
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then it is of interest to have these agents execute a braid 
cr € 'SpJ- We now define what it means for this braid to be 
executed. 

Given an input braid string a, what each individual agent 
should do is “hit” the intermediary braid points at 

specified time instances. We let T denote the time it should 
take for the entire string to be executed. As such, the first 
condition for a multi-agent motion to be feasible with respect 
to the braid is the following: 

Definition 3.1 (Braid-Point Feasibility): 

A multi-robot trajectory is braid-point feasible if 

Vjiti) = i = j = 

where the tfs form a partition of a given time window [0, T], 
i.e., 

to ^ 0 < ti < ■ ■ ■ < U < ■ ■ ■ < tM = T. o 


A. Braid Controllers: Stop-Go-Stop Hybrid Strategy 

Our first attempt at executing braids will be a hybrid control 
strategy called the Stop-Go-Stop. We will assume that agent 
dynamics are given by single integrator dynamics, i.e., Xj = 
Uj G with pj = Xj, j = 1,... ,N. Further, for practical 
considerations, assume that there is a cap on the maximum 
velocity achievable by the agents, i.e., |jujH G [0, Umax]- The 
idea is then at each braid step to “send” agents off straight 
to their next braid point in order of the distance they’ll need 
to travel, waiting just long enough to avoid collisions before 
sending an agent off. To that end, we define Si : N} -G 

N} to be a bijective mapping that denotes the farthest 
distance ordering at step i, that is 

St{p) < Si{q) 

II?(fp) - ?(* - - 1.9)11 


On top of braid-point feasibility, we also insist on the robots 
not colliding during the maneuvers. To a certain degree, this 
condition is what restricts the level of mixing that is possible, 
i.e., since the braid is constrained in a rectangle of fixed height 
and width, what length strings the multi-robot system can 
execute while maintaining a desired level of safety separation. 

Definition 3.2 (Collision-Free): 

A multi-robot trajectory is collision-free if 

\\yiit)-yj(t)\\>s,j, yiy^j, fe[o,r], 

where 6ij > 0 is the desired level of safety separation between 
agents i and j. o 

For convenience, we will refer to J = max Sij as the 
maximum safety separation such that no agent collides. This 
will come up in Theorem We are missing a notion to 
describe what the multi-robot mixing problem is, that is, what 
constitutes a braid controller. 

Definition 3.3 (Braid Controller): 

A multi-robot controller is a braid controller if the resulting 
trajectories are both braid-point feasible and collision free, for 
all collision-free initial conditions such that 

%(0) =C(0,j), j = o 

As a final notion, we are interested in how much mixing a 
particular system can support. 

Definition 3.4 (Mixing Limit): 

The mixing limit M* is the largest integer M such that there 
exists a braid controller for every string in o 

Whenever two strands of the braid associated with a given 
braid string cross, the two associated agents will have to inter¬ 
act. The mixing limit therefore serves as an input-independent 
bound on how much mixing is achievable for a given team of 
agents operating in a given environment. The mixing limit is 
in general quite hard to compute, it needs to consider every 
permutation of strings of varying lengths up to some number, 
the geometry assigned to each string and is dependent on 
the kinematical response of the multi-robot system. However, 
under certain assumptions it is possible to find bounds on M* 
for a given braid controller. 


where ties are arbitrarily broken such that Si remains a 
bijection. We let the agents heading angle be given by 9ij = 
tan ( 1 where the subscript indicates the 

first or second component, and the unit heading vector be 
Pi,j = [cos(0ij), sin(0ij)]^. Lastly, the time the agents will 
wait before entering GO mode will be given by their ordering 
as (si(j) — 1)t where 


IS 


Umax C0S(6»*) 

the time required to be 5 apart horizontal!with cos(0*) = 
-flM. - being the maximum horizontal distance an agent 


could travel given a G To ensure that the agents do 

not overtake the first agent (horizontally), the speed of the 
agents should be scaled by the velocity of the first agent, i.e., 
Uj = Umaxcos(0- )/cos(0i_s.(j)). The hybrid automaton 
describing the stop-go-stop controller is given in Fig. 

Theorem 1: 1281 The STOP-GO-STOP controller in Fig. |^is 
a braid controller if the braid points themselves are sufficiently 
separated and 


cos(6»*)umax (miu (L - L-i) - (A^ - l)r^ 

> y/£^fM^ + h^. 


Proof: 

The STOP-GO-STOP controller ensures that the agents are 
never within 6 of each other by virtue of the fact that they 
have to wait until they are indeed at least that far apart (hor¬ 
izontally) before entering GO mode. As such, the trajectories 
are collision-free. 

What remains to show is that they are also braid-point 
feasible. Consider the agent that has to wait the longest before 
it can move, i.e., the agent that has to wait a total of {N —1)t, 
and at its worst has min^ {ti — L-i) — {N — 1)t time left 
to reach the next braid point. In other words, we need that 
the distance traveled in that amount of time at the speed 

^ Since we are interested in the mixing limit, the analysis is done with the 
horizontal direction being the limiting factor for safe execution of the braids. 








* = U) - 1) T + ti-1 


Mixing Bounds 


5 



Fig. 4. Hybrid STOP-GO-STOP braid controller. 


^^maxcos(0j g-i^j^^)/cos(0i_s;(j)) is greater than the distance 
required. But, we note that 

t^maxCOs(6>.^^-l(^))/ COs{9i^Siij)) > 'Umax COs(6»*) 

and, as we are only looking for a bound, we assume that we 
use this lower speed and that the distance required to travel is 
the largest distance possible (which it really is not). In other 
words, we need 

cos(6»*)umax (niin (fi - fi_i) - {N - 1)t^ 

and the proof follows. ■ 

Note that Theorem implicitly provides a lower bound on 
the mixing limit as long as the agents’ paths are straight lines. 
In Fig. 1^ we can see the mixing limit as a function of the 
number of agents in the team for parameters Umax = 5, T — 
20, i — 5, h = 10, and A = 0.2. The problem with this 
strategy is that it does not allow for more general geometric 
paths (which could be interpreted as feasible trajectories under 
a given robot dynamical model), nor does it ensure that agents 
get within a specified distance from each other (which could be 
necessary when collaboration is required). The next section we 
present a new strategy called braid reparameterization which 
will explicitly consider more general strand geometries, and 
allow us to obtain analytical bounds on the mixing limit. 

B. Braid Controller: Braid Reparameterization 

We are now seeking a strategy that will allow us to follow 
a given geometry while achieving a mixing strategy encoded 
as a braid string a G Further, we wish to enforce inter¬ 
agent interaction as dictated in a by having agents get as close 
as the safety separation 6jk- Before moving forward, consider 
the following lemma. 

Lemma 1: If at any braid step, the generators in the braid 
substring <j{k) = a C E^, m < M, have indices that are two 
or more apart, then any agent interacts with at most one other 
agent at this step. 

Proof: 

Let B'f G be a matrix that contains the set of 

braid points at time k such that = [^(0,1) • • • ^(0, N)]'^. 
Consider the two-generator concatenation ai-aj. As a bijective 
map, if (Ti = <70. then the agents do not interact, and the agent 
in braid point position gets mapped to braid point 


u 

e 

u 

a 


u 

"a 

3 

z 



Fig. 5. Lower bound on the mixing limit using the Stop-Go-Stop braid 
controller. 


position [B’^]n, where [B\n corresponds to the row of B, 
n = I,..., N.lf ai f (To, then ai will swap the position of the 
two agents occupying the braid point positions i and i -f 1 at 
step k — l, i.e., it maps the agent occupying to 

and the agent occupying [B^^]i+i to [B^]i. Similarly, aj 
swaps the position of the agents occupying the braid point 
positions j and j -I- 1. 

The two agents in positions i and i + 1 at A: — 1 would only 
interact with the two agents in positions j and j+ l si k-1 
if i (or i -f 1 for that matter) is equal to either j or j -f 1. But 
if we let \i — j\ > 2, then we get that 

\i — j\>2 ‘2<i — j or 2<j — i 

=> j<j + l<j + 2<i<i + l 
or i<i-|-l<i-|-2<j<j-|-l 

( 

,1 + ^ 

I 

[ i + lfj + 1, 

and as such these two-generator concatenation maps the agents 
from one set of braid points to the next with at most two 
interaction between at most two agents per interaction. 

One of the two braid group relations pT[ , | [22) tells us that 
if \'i ~ j\ ^ 2 then (t^ • aj = aj ■ ai. More generally, if we let 

h : {l,...,iV- 1} 

be a surjective map such that \h{i) — h{j)\ > 2 for all 
i,j G m} with i f j, then for any bijective map 

g : {1,..., m} —)■ {1,..., m} we have that 

a{k) = ah(i) ■ (ih( 2 ) . (ih(m) 

= ^h{g(l)) ■ ^h{g{2)) . ^h(g(m))- 

As such, the braid generators can be rearranged to obtain any 
permutation of two-generator concatenations from generators 
in a{k). Since for all permutations of two-generator concate¬ 
nations we will have indices that are two or more apart, these 
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{(Tl • (73 • 0-2} {(7l • (73} • (72 

= {ct 3 • (7l • (72} = {(73 • (7l} • CT2 


(a) 


(b) 



(c) (d) 


Fig. 6. A braid string a = < 7 i ■ <73 ■ cr 2 taking place in a varying number of 
braid steps. 


will map the agents at braid step k from the set of braid 
points to the next set of braid points with at most 

TO interactions total, and at most one interaction per agent. ■ 

If the geometric interpretation of the braid string is restricted 
to the case of only pairwise interactions at every braid step, 
then it is possible to devise a hybrid strategy with the desired 
properties, which we can then compose together to achieve 
the desired interaction patterns. As such, we will restrict the 
geometric interpretation of braid strings to those satisfying 
pairwise interactions as in Lemma 

Restriction 1: As a bijective map from one set of braid 
points to another, the braid a{k) will only contain generators 
whose indices are two or more apart, i.e., for some h:N—t 
{0,...,iV-l} 

a{k) = ah(i) ■ ah( 2 ) -, where \h{i) - h{j)\ >2yi^j 

As an example, suppose that a braid string contains the 
substring of three concatenated generators ( 7 i • (73 • ( 72 . The 
first two generators, ai ■ ( 73 , may take place simultaneously at 
braid step 1 without incurring in more than one interaction per 
agent with another agent, but we would require an additional 
braid step for (72 in order to avoid multiple interactions in the 
same step. This is illustrated geometrically in Fig. In (a), 
an agent interacts with more than one other agent since all 
the generators are not at least two indices apart and take place 
at the same braid step. Note that in the remaining cases (b)- 
(d), we introduce intermediate braid points while retaining the 
desired level of interaction, final configuration of the agents, 
and reducing to pairwise interactions. 

Braid strings that satisfy Restriction will have at most 
interactions involving two agents at any given braid step. So 


in order to safely execute braids, one need only consider the 
case when two agents interact. We will devise a strategy for 
reparameterizing the geometry such that should two agents 
interact, the resulting parameters are at least S from each other. 
By tracking the parameterized paths, the agents’ trajectories 
will be collision-free and braid point feasible. The resulting 
controllers can be combined to satisfy a given braid string. 

Consider the geometric path agent j must follow at step 
i given by 7 ^ : [ 0 , 1 ] —with 7 ^( 0 ) = ^(i — l,j) and 
(1) = i)- Let A be the arclength of this path, given by 

^ = ^ ]/{ii (p)) il {p) dp- 

We wish to find a parameterization of the strand geometries 
such that the parameters of two intersecting strands, thought of 
as a virtual vehicles that live on their geometries, are collision- 
free. The strategy to do so will be to impose constraints on 
the agents separation from the path intersection at a specified 
time. To ensure braid-point feasibility, the strategy will be to 
impose constraints on the time in which the agents must get 
from the beginning of one braid step to the end of that step. To 
that end, we propose the following constrained optimization 
problem 

(u*, v^) = argmmJ(vj,Vk) = argmin - Vj +vldT 

{vj,Vk) ^ Jti-I 

( 1 ) 


subject to 


Pj = Vj, 

ti-l + L 
Pj 


A + 6 
2A ’ 


and 


Pj {ti—l) — 0, 
Pjiti) = 1, 


Pk — '^k 1 



A-5 
2A ’ 


Pkiyi — l) — 0 ; 


Pk{ti) = 1- 


The constraints at and L will ensure that the reparame¬ 
terization is braid-point feasible. For collision avoidance we 
will define a safety separation region, as depicted in Fig. 
|7] to be the region from the intersection point to the point 
where it is possible for the two agents to be within Sjk of 
each other, i.e., the set for S G [0, A] such 

that \\^-{pj) -yHPk)\\ > Sjk for all pj,pk G [0,1], where 
we let S be the distance from the intersection point to the 
boundary of the safety separation region along the path. Note 
that if the geometry of the braid strands are straight lines, the 
distance <5 can be easily computed by 5 = 6jk csc{6), where 
9 is the angle between the two intersecting lines, and this 
would also imply the parameters get as close as 5jk esc (9/2). 
Similarly, when the geometry is “city-block”-like, we can find 
= Sjk + 2 {n-i) agent get as close as 25jk- For 

more general geometries, 5 may be conservatively selected. 
At ti := , i.e., half-time along the braid step, we 

will require one parameter to exit the safety separation region 
as the other one is about to enter it. All these cases are 
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performed in a space of height h and length f in time T is 
bounded above by 


M* < min 


- ^2 (N -if 
^ Ih^ ' ™ 


Fig. 7. Safety separation region for three different-geometry, two-agent braids. 
For straight lines (left) or “city-block”-like (right), the distance 5 can be 
computed exactly. For arbitrary curves (center), the distance 5' can be selected 
consei'vatively. 


illustrated in Fig. This way we guarantee that the two 
parameters are never inside the region simultaneously and thus 
their separation will always be of at least 5jk- 

The optimality conditions for equation Q are given by 

Xj 0, Pj Aj, Pf^ A/^, 

Pk{ii) = ^, Pj{U)=pk{U) = l. 

Since Xj = = 0, we will get that Xj and Xk are piecewise 

constant. By using the midway condition, we have that for 

^ € {ii— 1 ; 

, A+ 5 
PjiU)=J^ VjdT=^^ 

N A + (5 

=> Vj{ti — ti-i) — 2^ 

1 A + (5 

^ ~ A {U - U-i) 

and similarly for t G the terminal condition tells us 

that 


(A^-l)(wT-(£ + 5)) l| 

h 2 j • 


Proof: 

Consider cr G Since at any step an agent can either inter¬ 
act with another agent or move straight ahead, the maximum 
mixing will be achieved if an agent interacts with another 
agent at every step. Thus, at every step it must be enforced 
that there are no collisions. Assuming a uniform partition of 
the time window, the arclength-normalized parameter velocity 
will be given by 


( mKtms\ 

\ TA ) 




for 7 = 1,2,..., M, where the sign on the numerator depends 
on the interpretation of whether the “strand” goes over or 
under, A is the arclength of the strand geometry connecting 
two braid point, assumed equal at each braid step and for both 
agents due to symmetry, and <5 is the safety separation distance 
along the braid as described above. The total braid path length 
A heavily depends on the geometry of path. However, for the 
sake of obtaining bounds on the mixing limit, we may assume 
that the braid points are uniformly distributed in height and 
length, such that the length of sufficiently regular paths will 
be bounded by 


PjiU) = 


Vj dr - 


A + ,5 _ A 
“ A 


2A 


1 


Vj{ti -ti) = —i2A-A + 6) 


2A 


Vi = 


1 A-(5 

A {ti - U-i) 


Note that for agent k, the signs are reversed on the numer¬ 
ator. As such, the resulting braid parameterization will have 
velocities given by 


Pjit) 


1 A±^ 

A 


i G {ti—i , ti\ 
t G iii,U] 


( 2 ) 


where the sign in the numerator is determined by the interpre¬ 
tation given to the braid strand going “under” (e.g., the agent 
crosses the intersection point first) or “over” (e.g., the agent 
crosses the intersection point second), and in cases where there 
are no intersections we set i5 = 0 in the numerator. 

It is possible to come up with an upper bound on the 
length of the braid attainable under this mixing scheme. Under 
Restriction [T] the following theorem provides an upper bound 
on the mixing limit. 

Theorem 2: Given the maximum safety separation 6 and 
bounds on the agents’ velocities such that Vj{f) G [0,Uniax] 
Vt,j, the mixing limit M* for V-agent braids that can be 



(3) 


where the lower bound assumes straight lines connecting the 
braid points and the upper bound assumes “city block”-like 
paths stepping midway between the two points. But after 
normalizing the bounds on the parameter velocity, we see that 


M(A-S) M(A + S) tw ,., 

TA - TA - A ■ ^ 

The lower bound of Q tells us that for the parameter to not 
go backward s we need 6 < A . To ensure this, we set 6 = 

Scsc9 < + (]g)^ < A, and since we require 

S < for collision-free braid points, using the geometric 
relationships to solve for M yields 


M < 


{N-lf 
Sh " 


Similarly, the right-hand side inequality of Q tells us that 
A < and to ensure this we 

set A < ^ + Solving for M 


yields 


M < 


(iV-l)(wT- (£ +j)) 


1 

2 ' 


h 
































Fig. 8. Upper bound on the Mixing Limit presented in Theorem for 
pai'ameters i = 2 m, h = 4 m, S = 0.13 m, t;max = 2 m/s 


Thus 

f (N-if 

M* < min -=-, 

- I Sh 

(iV-l)(wT-(^ +j)) l| 

h 2 j ■ 

Theorem provides a compact expression to obtain an 
upper bound on the mixing limit that abstracts away strand 
geometry. It provides a notion of the whether or not desirable 
mixing levels are achievable in the space, regardless of what 
the actual movement patterns to achieve these mixing levels 
are (encoded in the braid string of length M < M*). Fig. 
includes a plot of the bound on the mixing limit for varying 
number of agents and time window size. 


C. Non-Rectangular Regions 

Up to this point, only the problem of braiding on a rect¬ 
angular region of height h and length I has been considered. 
On this region, the braid points were uniformly distributed 
along both dimensions and bounds on the mixing limit were 
provided through the use of the proposed braid controller. In 
this section, the scheme is extended to more generally shaped 
regions, e.g., the road on Fig. As has been done previously, 
discussion begins by first considering the two agent case. 

Consider the two agents attempting to perform a braid 


of length one on the arbitrarily curved region on Fig. 9b 


Connecting the braid points together results in the quadrilateral 
depicted in the red dotted line. Let this quadrilateral be 
considered as the space where the agent needs to perform a 
braid of length one, rather than the curved region itself Note 
that as longer length braids are included in this road segment, 
other quadrilaterals appended together will be obtained which 
approximate the road slightly better. Since it is of interest to 
obtain mixing strategies near the mixing limit, as longer length 



(a) Three agents braiding on a curved region. 




(b) Two agents need to move 
from the left-most circles to 
the right-most circles along 
the curved region. 

Fig. 9. 


(c) The longer the braid length 
in this curved road segment, 
the closer the quadrilaterals 
resemble the curved region. 


Agents braiding on a region that curves. 


braids are included in this road segment, better approximations 
of the curved region will be obtained by these composition of 
quadrilaterals. This is depicted in Fig. 

The strategy for performing a mixing strategy in curved re¬ 
gion will be to transform the curved region into a straightened 
rectangular region of known height and length, as illustrated 
in Fig. 10a In this way the braid controller can be fashioned 
as in previous sections and the resulting braid controller can 
be transformed back into the actual curved region. After 
distributing the braid points on both the curved region and 
the rectangular region, as in Fig. |10a[ the next step is to find 
a transformation to map between these two regions. 

Let agents j and k interact in at braid step i. Denote S'j^j 
to be the quadrilateral formed by connecting together the 
braid points ^{i — and ^(i,/c), like 

the one depicted in Fig. l9b| Let ^ be a rectangular plane 
of specified height and length whose corners are given by 
^ -i •, and k). 

With knowledge of these braid points and through the use of 
a projective transform as in pO) , it is possible to obtain a local 
diffeomorphism that maps from a rectangle of specified height 
and length to the convex arbitrarily shaped quadrilateral, i.e., 

T;., ^ 




^Ir 


Note that by selecting transforms based on the corners of 
these quadrilaterals, a continuous curve that spans across the 
boundary between and j might be mapped to a 
discontinuous curve that spans across the boundary between 
and j when transformed using Tij and Ti+ij in their 
respective spaces. However, there will certainly be continuity 
in the mapping of curves passing through the braid points, 
since these points are shared by the quadrilaterals and are 
used to compute the transforms, i.e., Tij = 

'fi+lj i^rihj))- 


Recall the braid controller proposed for the rectangular 
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(a) The curved region will be mapped to the rectangular region of 
known width and height where control design will take place. 



(b) The bijective transformation T maps points in the rectangle to 
points in the quadrilateral. Both shapes are defined by the braid points 
which determine the comers. 

Fig. 10. Rectangular and non-rectangular regions. 


region. For agent j, at braid step i, this was given by 

if t e (fi-iJj], 
if f e . 


,{t) = 



( ^ 

J A ' 


i 1 1 

( ^+'5 1 


J 


where it is expected that {x (ti-i)) = — l,j) and 

T~j^ {x(ti)) = In the expression, A corresponds to 

the length of the geometric path agent j must follow to move 
between ~ !> j) and while S corresponds to the 

distance along the path agent j switches velocities in order to 
avoid collisions. Note that for a given parameterization of the 
geometric path in j with parameter p G [ 0 , 1 ], the 

arclength A may be computed as follows 

^ = / \/7*>b)7i',r(F)dp. 


If the geometric curve is directly given in as 7 ^ (p) such 
that the curve in S[j may be parameterized as llr(p) = 
(p)), then the arclength may be computed by 


point along the curve where the two curves intersect (resp. 
where the agent exits the safety separation region). 

In the special case where the geometry is given by straight 
lines, then by setting 

l7ip) = (1 - 1 )«) +Pi{hn), p G [ 0 , 1 ], n = j,k. 


as the path agent j and k must follow, the intersection point 
s may be found by setting s = 7 ^ = 7 ^( 71 ^) where 


= A ^ -l,k)- - l,j)) 


withal = [(^(*,i)-C(*-l,j)),-(^(i,fc)-C(i-l,fc))]- 
Recall that the distance in j from the intersection point s, 
for the special case of the geometry being straight lines, was 
given by (5 = Sjk csc(0) with 0 being the angle between these 
two lines, i.e., 0 = cos~^ (xjxk) where £„ is the unit vector 
pointing towards the next point, i.e., 

(^(i,n) - - l,n)) 


Xn = 


n = j, k. 


||^(i,n) - - l,n)|| ’ 

By setting j{p) = (1 — p)s ± pSxj, where sign depends on 
whether the braid goes “over” or “under,” it is possible to 
determine S in the non-rectangular plane directly as 


6r = 


'Vi 


zLSxj — s) A4 (jip)) V^Xj — s) dp. 


With this information, u, can be found in S’'^ for interactions 
between agents j and k. Note that a reparameterization of the 
path can now be set equivalent to the desired trajectory of 
agent j by setting -/f Jt) = VW (see 0 below). Thus, 
the braid controller parameter velocity Vj{t) for agent j in 

Vj will be given by v]{t) = DTi^jW^V'^) 

This strategy was implemented in simulation over the 
curved region illustrated in Fig. 11 In the hgure, agents are 
performing the mixing strategy given to them by a braid of 
length 80 on the curved region (top) and simultaneously on the 
straightened rectangular region (bottom). The parameters used 
for this simulation were 6jk = 7.7 cm and Vmax = 1-5 m/s 
Vj, k, and T = 30 s. 


A = ^ y (ii (p)) M{-fi (p) )'jf (p) dp. 

where M( 7 |(p)) = ( 7 * (p))) DTi~^ (ji{p)^ 

and DTV is the Jacobian of TV- In the special case 
where the geometry is given by straight lines, then A = 

Finally, it is of interest to hnd 5 in order to avoid collisions. 
If the parameterization 7 ^ (p) of the curve in S/, is known, 
then the safety separation ball may be set in ^ as before 
and the safety separation distance may be computed as 

S = J \j (p)) M i-fi ip))ji (p) dp. 

where [a, b] C [0,1], and if the agent is meant to braid “over” 
(resp. “under”) then (a) corresponds to the point along the 
curve where the agent enters the safety separation region (resp. 
where the two curves intersect) and 7 ^ (5) corresponds to the 


IV. Implementing Braids 
Section approached the problem of multi-robot mixing 
from an execution level, where given a specihcation it is 
possible to synthesize a braid controller that satishes the 
specihcation. In this section we consider the implementation 
level, that is, we address how to hnd controllers that are 
implementable on actual robotic systems that follow the braid 
controllers found in the previous section. We then validate the 
framework by implementing a mixing strategy on a team of 
six robots. 


A. Optimal Tracking Controller 


We will now utilize the braid parameter velocity to hnd the 
braid controller for the agents. By integrating 0 we obtain 
the braid parameterization of the path 7 ^ 


Pjit) = 


t-tj-i A±^ 

A 

t—tj Ati? 

A 


A±^ 

2A 


^ € (fi— 1 J fz] 
t G (UAi] ■ 


(5) 
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Track (Real World) 


Zoomed in Track (Real World) 


3.5 4 

East (m) 


0 1 2 3 4 5 6 

East (m) 




0 1 2 3 4 5 6 

East (m) 


East (m) 


Track (Real World) 


Zoomed In Track (Real World) 


Straightened Track (Virtual World) 



4 6 8 10 12 

Counter Clockwise along Path (m, along Center of Path) 

(a) Simulation Time 5.04 seconds. 


Straightened Track (Virtual World) 



4 6 8 10 12 

Counter Clockwise along Path (m, along Center of Path) 

(b) Simulation Time 9.57 seconds. 


Fig. 11. Five agents performing a mixing strategy given by a braid of length 80. The top left plot represents the actual curved region the agents are mixing 
in and the top right is a close-up of the agents. The lower plot is the virtual “straightened” rectangular region where the design of the braid took place. 


Assume that agents have single integrator dynamics, i.e., Xj = 
Uj with Uj = Xj G The agent’s controller will be found 
by optimally tracking the reparameterized path jf(pj(t)) to 
minimize the cost 

) = ^ ^ - 7 i) Q (xj - 7 l) + uJRuj dT ( 6 ) 

for Q = >- 0 and R = >~ 0, with constraints 

Xj = Uj, Xj{ti_i) = 7-(0), and Xj{U) = 7-(l). Using 
the standard variational argument together with Pontryagin’s 
minimum principle, the first order necessary conditions for 
optimality tell us that the optimal tracking controller u* is 
given by 

u* = -R~^Xj 


where A is the so-called costate and satisfies 


Xj — —Q ^ 


Xj - Ti 


with unknown terminal condition Xj{ti). Suppose that simi¬ 
larly to 131 Chapter 5.3] we can construct Xj as an affine 
combination of the unknown Xj{ti) and the state, i.e., 

Xj{t) = H{t)xj{t) + K{t)Xj{ti) -f E{t) 


and similarly, the terminal state as 

Xj{ti) = F{t)xj{t) + Git)Xj{U) + D{t) 

for some yet unknown functions H, K, E, F, G, and D. One 
can differentiate these equations and manipulate the equations 
to obtain 


{hr-^h -Q-H^Xj + {hr-^k - k'j XjiU) 

+ (^HR-^E + Qjf -e'J =0 

and 


[fR-^H - f) Xj E {fR-^K - g) Xj{ti) 

E {fR-^E -D^=Q. 


In order to satisfy these equations for any value of Xj(t) and 
Xj{ti), the terminal conditions, and after noticing that F = 
, we obtain that 


ij = HR-^H-Q, 
k = HR-^K, 

G = K^R-^K, 

E = HR-^EeQ7 
D = K^R-^E, 


H{ti) — 02x2 
K{ti) = h 

G{E) = 02X2 (7) 

E{ti) = 02x1 
D{ti) = 02x1- 


Note that G{ti) = 0 and G{t) E 0 for all t, which suggests 
that G{t) ^ 0 for f < F. If the problem is not abnormal, i.e., 
there exists a neighboring minimum solution, then G will be 
invertible at some t < ti. In particular, by solving backwards 
in time in the sequence FI^K^E^G^D up to 
t = ti-i, we can find that 


Xj {ti) — 

G-i (f,_i) (^ (z, j) - (f,_i) ^ (z - l,j) - D (f,_i)) 

resulting in the feedback optimal trajectory tracking control 
law 


]{xj,t) = -R ^ H{t)xj{t) E K{t)G ^{U-i){i{i,j) 

- K^{U_^)^{i - 1,j) - D{F_A E E{t)] (8) 


where FI, K, E, G and D are the solutions to terminal value 
problems in Q. which can be solved numerically backwards 
from ti- As it turns out, these conditions are also sufficient for 
optimality as presented in the following theorem. 

Theorem 3: The tracking controller in ([^ is a minimizer to 
the cost functional (|^ whose optimal value is given by 


J{k)= [-H-KG-^K^ )e(*-l,j) 


+ i{i - l,j)^ {KG-^ -D)eE) EE 
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(a) The robots start at the beginning of the braid. 




(c) The controller is braid point feasible - braid points are reached simultaneously. 


Fig. 12. Actual robots executing the mixing strategy in 0- The geometric paths and spatio-temporal constraints are being projected on the workspace with 
an overhead projector for the sake of visualization. 


where tf{t) is the solution to the terminal boundary problem 
^=\ i [-il (i)) Q-il (t) 


with 


Kj (i) — E[t)-\- 

- 1-j) - D{U_^)). 

Proof: 

As the control law was derived from the necessary conditions 
for optimality, we only need to show that it is sufficient for 
optimality. We will do so by leveraging the Hamilton-Jacobi- 
Bellman theorem ||32l Chapter 2]. 


Note that the optimization problem is regular as there exists 
a Uj that allows the Hamiltonian to achieve a minimum with 
respect to it, i.e.. 


T~L{xj, Uj , Xj ) 


(xj - 7^) Q (xj - 7*) + uJ Ru 


+ 


which attains a minimum with respect to Uj when 
u* = 
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(a) Robot trajectories in the plane. 

Fig. 13. Data associated with robotic implementation in Fig. |12| 



(b) Instantaneous minimum inter-robot distance. 


Define V{z,t) as 

yiz,t) = H(t)z + z'^ 

+ 

where (p{t) is as defined above. It can be verified that 
V{z,t) satisfies the terminal condition j),ti) = 0, that 

T 

= Xj, and that is satisfies the Hamilton-Jacobi- 

* Z=Xj 

Bellman equation, i.e., 


0 = 


dV iz,t) 


dt 


-t- "H I a;j, It* {xj , t) 


dV{z,t) 


dz 


in order to obtain the fully closed-loop optimal tracking 
controller 

u* *{x,,t) = -R-^ - K{t)G-\t)K^{t)) Xj{t) 

EK{t)G-\t) (C(t, j) - D{t)) + Fit)] . (9) 

B. Robotic Implementation 

In order to validate the above results in a practical setting, 
the braid controllers were implemented on a team of Khepera 
III differential-drive robots, which may be modelled using 
unicycle dynamics, i.e.. 


■,j = cos 9j Uj sin ^ , 


0j =U}j. 


where Xj G is the robot’s position and 9j its heading. 
The single integrator control uj from 0 can be mapped to 
unicycle dynamics as 


As a consequence, u* is a minimizer to the cost functional 
and 

J{u*) = V{ai-lG):U-l). m 

As a final note, the terminal costate value Xj{ti) was com¬ 
puted using the initial conditions for the problem. However, 
as the gains involved are solved from terminal conditions, 
the choice of initial conditions is arbitrary, and evaluating at 
t = ti_i results in control law (|^ being open-loop in the 
terminal costate value. This could yield undesired results under 
the influence of disturbances and errors. To alleviate this, we 
can rewrite the terminal costate as a function of the current 
state value instead, i.e., 

G-1 (e (2, j) - (f.-i) ? {i - 1, j) - D (f,_i)) 

= (t) (C ihj) - (t) Xj {t) - D (t)) 


Uj = [cos^j sin^^] 


'^3 
UJj = 


3 \ ' 

cos 0, 1 . T 
J I 

cosfl, 1 • 1 


K [ - sine 
K [ — sine 


if 


> 1 


otherwise 


for tuning gain k > 0. Fig. illustrates the team of 6 real 
robots executing the braid string 

a = {cri-(T3-(J5}-(T2-CT3-cr4-{CT3-cr5}-{cr2-CT4}-CTi (10) 

where the braids grouped in braces are executed simultane¬ 
ously. A visual representation of the braid string geometry 
is being projected onto the robot workspace via an overhead 
projector mounted on the ceiling of the lab space. Fig. 
|13b| illustrates the minimum pairwise distance throughout the 
execution of the braid. It can be seen that the minimum 
distance achieved is approximately 0.132867m - greater than 


the size of the robots which is approximately 0.13m. Fig. 13a 
illustrates the trajectories taken by the robots and how they 
follow the strand geometry, which were selected as straight 
lines, while still accommodating for the agents’ unicycle 
dynamics. 
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V. Conclusion 

The notion of multi-robot mixing is presented as a frame¬ 
work with which to characterize rich movement patterns in 
a multi-robot system symbolically in terms of inter-robot 
interactions. Two controllers are presented which allow to the 
multi-robot system to achieve provably safe interactions, in the 
sense that agents get close without colliding, while meeting 
certain spatio-temporal constraints. Under these controllers, it 
is possible to obtain theoretical bounds on the mixing limit, the 
greatest level of mixing or inter-robot interactions achievable 
in a given region. Further, tracking controllers that optimally 
follow desired geometries are provided which can be mapped 
to classes of nonholonomic dynamical systems. The concepts 
presented here are validated on an actual multi-robot system 
executing a interaction patterns with a desired mixing level. 

Not found in this paper is the question of how to select the 
interaction pattern that should be executed by these controllers. 
This question addresses the specification level of our symbolic 
approach. This discussion will be presented in a different paper 
where motion tasks are encoded in linear temporal logic, 
allowing for syntactically rich specifications at a high level, 
such as “agents 1 and 3 need to collected data before arriving 
at a goal location,” which are then translated into a mixing 
strategy encoded as a braid. 
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